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Efficient Reliable UDP 
using 
Packet Duplicator 

Preliminaries 

In order to support a large number of broadband movie streams simultaneously, when 
each stream is, say, lmbps, full screen, full length, MPEG-2 / MPEG-4 movie, there is a 
need for a large "farm" of strong servers. 



A multi-cast based data distribution system (hereafter "bandwiz system") is described, for 

ru example, in a US provisional patent application serial number 60/1 76,926, a US 

1 1 provisional patent application having serial number 60/217, 1 39, an Israel application 

P having serial number 1381 14 and an Israel application having a serial number 137624, 

j;3 lhe disclosures of which are incorporated here-in by reference. 

.7 ^ exemplary described system uses a FEC erasure code to multicast information to 

J* cherts. The content of the multicast packets, is determined, for example, based on 

b statistics of requests made by the clients, from web servers, from which the data is 

I-* retri eved for multicasting. 



One solution to the problem above is to use Bandwiz system. This system can support 
streaming to so many users using sometimes a single server. The system requires in a 
typical example: 

1 . Client at the desktop. 

2. Multicast IP network between the server and clients. 

3. Overlap between die movies. 

4. Short delay at the start. 

5. Somewhat higher bandwidth at the receiver side. 
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This disclosure propose a way to eliminate the multicast requirement, by using a packet 
duplicator. 

Application-Level Multicast 

The basic idea is to implement application-level multicast, by duplicating packets, using, 
as one example, the system below. 

This system is better than standard video server, because it is easier to duplicate packets 
thanlo-create.them 



Packet 
Duplicator 





Movie 




Session 




Pumper 




Manager 



Is 



100mbps Ethernet 



1Gbps Ethernet 




PC + BW 



Movie Pumper component 

This component is part of the bandwiz system mentioned above, where for example, a 
single PC is capable of pumping 1 0 different movies, each with expansion factor N-* 5, 
with source bit-rate of lmbps per movie, giving total of 50mbps. This is achievable with 
reasonable amount of work, or, by using a PC with enough memory to hold all movies 
simultaneously, Le-, 10GB of memory. 



w 
o 
ry 



212/01935 

AU the packets are standard unicast UDP packets, sent to the packet duplicator. They can 
be sent, for example, over the lOOmbps Ethernet card. A part of the payload of the packet 
is the "multicast address" of it. 

A slightly different approach will be to use an un-modified movie pumper, which sends 
multicast packets, and use the packet duplicator in order to join that multicast group, and 
convert it to unicast In this case, a partially deployed IP multicast can be utilized. 

Session Manager component 

For each "multicast address" the session manager keeps track of the IP addresses and 
ports of the connected clients. Each client can send "join" / "leave" / "keep-alive" UDP 
packet to the session manager, giving the multicast address, the destination IP address 
and port. 



j~ In order to support congestion control for standard FEC, one can add the concept of join 

0 to a specific rate. The client will have the ability to join "multicast address", but to get 
g only a given percent of the packets. This can be implemented using the well-known bit 

1 reversal mechanism, assuming the manager knows the bitrate of each stream 

;.± 

I A 

£3 Each connection is defined by: 

j'3 1 • The address of the manager (possibly pumper). 

O 2 - The "multicast address" inside it (say, source UDP port). 

3. The IP address of the client. 

4. The UDP port in the client 

For each connection, the client can issue a single command, which specifies the 
connection, the maximal bitrate, and the duration. If the maximal bitrate is zero, it is a 
leave command. Otherwise, this is a join / rate-change / keep-alive command. 

After the duration has passed, the connection will be dropped. This allows us to 
disconnect clients that were disconnected suddenly. 
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Packet Duplicator component 

The packet duplicator gets the tabic as defined above, and duplicates incoming packets, 
from, say, the I OOmbps Ethernet, to the 1 Gbps Ethernet. We need two interfaces in order 
to have high utilization of the lGbps Ethernet, by eliminating congestion. 

The duplicator should be able to achieve the entire lGbps capacity or the channel. This 
can be done, for example, using direct manipulation of drivers in Windows 2000, or by 
using Free BSD with _Zero Copy SpcketsjmplementatioiL. 

— V, 

Please notice that I GHz PC has more than 4000 clock cycles per packet, which seems 
more than enough in order to: ^\ 

1 . Get the next IP address, UDP port and bitrate from the table, 

2. Check the threshold for rate, 

3 . Put them in the packet header, 

4. Update the checksum, 

5. Send Hie packet using DMA. 

Client(s) component 

Each client may be a PC with Bandwiz client install ed- 

Onc possibility is that the client implement some form of MRCC- The possible 
modifications from MRCC are: 

1 . Send "join" / 'leave" to the manager, not IGMP commands. 

2. Do not implement layers in MRCC. Instead, use the congestion control offered by 
the packet duplicator. 

3 . A lot of small changes and simplifications. 
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Security 

We may add some form of security and system stability- For example, in order nol to 
"push" too much data to a client, we may check that each client is not connected for too 
many streams. For example: 

1 - Give "busy tone" if there are more than some number of connections. 

2. Limit the number of connections a single client can use. 

3. Limit the rate that the client can join to. 

4. Ask the client for a proof that it has the right rate, by giving some cookies fiom 
the previous packets. 



Packet Duplicator for "HTTP over Multicast" 

Bandwiz system can also designed for general efficient content delivery, i.e., "HTTP ove 
Multicast". The purpose of this system is to accelerate web-site, reduce the output 
bandwidth, and reduce the number of servers needed to support the request for content 
from this site. Usmg the packet duplicator mis system can operate without the 
requirement for native multicast In this case, the packet duplicator is interfaced with 
Bandwiz server, where a multicast transmission is translated into packet duplication of 
coded packets by the packet duplicator. The bandwiz server works, as usual, by 
adoptively deciding what content to multicast, and how to group content together. Now, 
when the server decides to multicast a content, it encodes it and start sending it to the 
packet duplicator which efficiently duplicate the packet to all users who request (m non- 
overlapping times) this content Note that the system does.no* save the output bandwidth, 
but save server resources, and thus, in general, accelerate the site. 



212/019; 

Specification 

Finally, below is a description of a possible implementation, which is a combination of 
the Session Manager and the Packet Duplicator, as defined above. The preferred option is 
written in italics. 

Options for packaging: 

1. 1U, 19" machine. 

2. Modified Linux kernel which can mothers The management is 

in the application level. 

3 . Modified Windows 2000 Giga Ethernet drivers, as above. 

4. Slow, application level program. 

s 

Options for input packets: 

1 . Receives unicast UDP packets, in a specific format, containing; stream id, packet 
1 rate, and payload. 

jp 2. Receives multicast UDP packets, using IGMP joirtAeave commands. In this case, 

P the stream id is the multicast group number, and the packet rate is not supported. 

a 

l* Options for configuration: 

j* l leaser specifically asks for the stream, by sending UDP "join" commands. This 

_ box is responsible of joining real multicast groups, management, security, and 

' j* limitations. The "join" / "leave" commands should be able to push data to the 

O logfile. 

2. There is some configuration machine, instructing the box to send to a given set of 

users using telnet / SNMP. This box is stupid- 
Other (relevant for some machines): 

1 . There will be an option to connect using telnet / SNMP, and get current state / log 
files / statistics. 

2. Security issues & resource management should be defined. 
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Claims: 

1 . A packet duplicator that emulate the operation of a multicast router, but send the 
packets in umcast to each end user that request the information. 

2. A packet duplicator, as in 1, where the packets are coded by EEC. 

3. A system for efficient streaming of (near) data on demand, based on coding, 
multicast and efficient delay, where the packet duplicator implements the 
multicast 

4. A system for efficient content delivery, based on utilizing overlap in requests to a 
web site, where the multicasted data is duplicated by the efficient packet 
duplicator. 



